Skip to content

Basic support for OTTL in transform processor#2806

Open
albertlockett wants to merge 4 commits into
open-telemetry:mainfrom
albertlockett:albert/2736-OTTL-parser-basics
Open

Basic support for OTTL in transform processor#2806
albertlockett wants to merge 4 commits into
open-telemetry:mainfrom
albertlockett:albert/2736-OTTL-parser-basics

Conversation

@albertlockett
Copy link
Copy Markdown
Member

@albertlockett albertlockett commented May 1, 2026 •
edited
Loading

Status: Work in progress TODO:

  • additional tests in OTTL Parser

Also #2797 can merge first and I'll fix the conflicts on this PR after it is merged.

Change Summary

Adds very basic support for OTTL in the transform processor. All it is currently capably of is setting the value of some field to a literal. Example:

version: otel_dataflow/v1
engine: { }
groups:
  default:
    pipelines:
       # ...
        nodes:
          transform:
            type: processor:transform
            config:
              ottl:
                log_statements:
                - set(severity_text, "ERROR")

There is still quite a lot of work to do in the OTTL Parser & Query-Engine support additional capabilities.

What issue does this PR close?

How are these changes tested?

Unit

Are there any user-facing changes?

Yes - OTTL configuration is now available in transform processor.

@github-actions github-actions Bot added rust Pull requests that update Rust code query-engine Query Engine / Transform related tasks query-engine-ottl OTTL usage of Query Engine query-engine-columnar Columnar query engine which uses DataFusion to process OTAP Batches labels May 1, 2026
@codecov
Copy link
Copy Markdown

codecov Bot commented May 1, 2026 •
edited
Loading

Codecov Report

❌ Patch coverage is 79.71698% with 43 lines in your changes missing coverage. Please review.
✅ Project coverage is 85.90%. Comparing base (b645a26) to head (7ab6840).
⚠️ Report is 15 commits behind head on main.

❌ Your patch check has failed because the patch coverage (79.71%) is below the target coverage (80.00%). You can increase the patch coverage or adjust the target coverage.

Additional details and impacted files 
@@            Coverage Diff             @@
##             main    #2806      +/-   ##
==========================================
- Coverage   86.03%   85.90%   -0.14%     
==========================================
  Files         720      727       +7     
  Lines      273264   275623    +2359     
==========================================
+ Hits       235095   236761    +1666     
- Misses      37645    38338     +693     
  Partials      524      524
Components Coverage Δ
otap-dataflow 87.02% <79.71%> (-0.18%) ⬇️
query_abstraction 80.61% <ø> (ø)
query_engine 89.57% <ø> (ø)
otel-arrow-go 52.45% <ø> (ø)
quiver 92.25% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@albertlockett albertlockett changed the title [WIP] Basic integration of OTTL in transform processor [WIP] Basic support for OTTL in transform processor May 1, 2026
@albertlockett albertlockett force-pushed the albert/2736-OTTL-parser-basics branch from c3e0ebf to e04208b Compare May 15, 2026 15:38
@albertlockett albertlockett changed the title [WIP] Basic support for OTTL in transform processor Basic support for OTTL in transform processor May 15, 2026
@albertlockett albertlockett marked this pull request as ready for review May 15, 2026 16:41
@albertlockett albertlockett requested a review from a team as a code owner May 15, 2026 16:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

query-engine Query Engine / Transform related tasks query-engine-columnar Columnar query engine which uses DataFusion to process OTAP Batches query-engine-ottl OTTL usage of Query Engine rust Pull requests that update Rust code

Projects

OTel-Arrow
Status: No status

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@albertlockett